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Abstract 

We present an algorithm for the well-known hidden-surface elimination 
problem for rectangles, which is abo known as the window rendering problem. 

The time complexity of our algorithm is sensitive to the size of the output. 
Specifically, it runs in time that is 0(n 1-5 + k), where fc is the size of the 
output (which can be as large as @(n 3 )). For values of k in the range between 
n 1,s /logn and n 2 , our algorithm is asymptotically faster than previous ones. 

1 Introduction 

The hidden-surface elimination problem is well known in computer graphics and com- 
putational geometry [6,12,13,15,16,19,20,21,22]: one b given a set of simple, non- 
intersecting planar polygons in 3-dimensiona! space, and a projection plane r, and wishes 
to determine which portions of the polygons are visible when viewed from infinity along 
a direction normal to v, assuming all the polygons are opaque. An important special 
case of this problem occurs when the polygons are all iaothetie rectangles, i.e., the rect- 
angles are all parallel to the xy-plane and have sides that are parallel to either the x- 
or y-axis. This version of the hidden-surface elimination problem is also known as the 
window rendering problem [4], since it is the problem that must be solved to render the 
windows that might need to be displayed on the screen of a work-station. (See Figure 1.) 
Another situation where one often wishes to render such a collection of rectangles is in 
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K-0502 and N00014-86-K-0689, and the National Science Foundation under Grant DCR-8431323, with 
matching funds from AT&T. Part of this research was carried out while this author was visiting the Re- 
search Institute for Advanced Computer Science, NASA Ames Research Center, Moffett Field, California. 
3 This author’s research was supported by the National Science Foundation under Grant CCR-8810538. 
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Figure 1: (a) isothetic rectangles; (b) their visible portion. 


drafting software, where any time a rectangle Ri is created, by the draftsman, before 
rectangle £3 is created, then R\ is “behind” £2, unless the draftsman explicitly changes 
this ordering (e.g., by executing a “move to front” command on Ri or, equivalently, a 
“send to back” command on R*)- 

Using the terminology of [22], we are interested in the object space version of this prob- 
lem. That is, we want a method that produces a device-independent, mathematically- 
based representation of the visible surfaces. One reason for our interest in an object 
space solution is that such a solution is not dependent on a certain method for rendering 
polygons nor on the number of pixels on a display screen (which seems to grow with 
each passing year). In addition, an object space solution gives us a representation that 
is easily scaled and rotated. 

We briefly review some of the efficient algorithms for the window rendering problem. 
Since this problem is a special case of hidden-surface elimination [13], any algorithm 
for the general case can also be used for this problem. In [13] McKenna shows how 
to solve the general hidden-surface elimination problem in 0[n 3 ) time, generalizing an 
algorithm by Devai [6] for the easier hidden-line elimination problem that also runs in 
0(n 2 ) time. (In the hidden-line rumination problem one is only interested in computing 
the portions of the polygonal boundaries that are visible.) Both of these algorithms are 
worst-case optimal, because there are problem instances that have ©(n 2 ) output size 
(e.g., a collection of rectangles that form a cross hatched pattern, as in Figure 2a.) 

Unfortunately, these algorithms always take 0(rz 2 ) time, even if the size of the output 
is very small (e.g., 0(1)). There are algorithms that run faster than 0(n 2 ) for certain 
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Figure 2: (a) Quadratic output size; (b) Small output size with 
quadratic I. 

problem instances, however. We review these next. 

In [15] Nurmi gives an algorithm for general hidden-line elimination that runs in 
0((n + /) log n) time and 0((n + /) logn) space, where I is the number of pairs of line 
segments whose projections on v intersect (I is 0(n 2 )). Schmitt [19] is able to achieve 
this same time bound for hidden-surface elimination using only 0[n + 1) space. If I is 
o(n 2 /logn), then these algorithms clearly run faster than 0(n 2 ) time. Their worst-case 
performance is, however, a suboptimal 0(n 2 logn) time (if / is ©(n 2 )). 

In [12] Guting and Ottmann address the window rendering problem (they are proba- 
bly the first to study this important special case of hidden-surface elimination), giving an 
algorithm that runs in 0(n log 2 n + /) time. In [9] Goodrich shows how to solve general 
hidden-line elimination, and a version of hidden-surface elimination that includes the 
window rendering problem as a special case, in 0(n log n + I + P ) time, where P is the 
number of pairs of polygons whose projections on jr intersect [P is 0(n 2 )). Both of these 
algorithms are optimal in the worst case and also take advantage of problem instances 
that are “simpler” than in the worst case, but they are not truly output-sensitive. In- 
deed, there are problem instances where these two algorithms run in 0(n 2 ) time even 
though the output size is very small (e.g., a large rectangle that covers up a collection 
of cross hatched rectangles, as in Figure 2b.) 

Recently, Bern [4] and Preparata, Vitter, and Yvinec [18] have shown that one can 
solve the window rendering problem in 0(n log n log log n+k log n) time and 0(n log 2 n+ 
Iclogn) time, respectively, where k is the actual size of the output (recall that k is at 
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worst 6(n 2 )). Thus, they have shown that one can solve the window rendering problem 
in an output-sensitive manner. Their algorithms are not worst-case optimal, however. 

In this paper we give an algorithm for the window rendering problem that is both 
worst-case optimal and output-sensitive. Specifically, our algorithm runs in 0(n i s + k) 
time, where k is the actual size of the output. Thus, our algorithm is faster than those of 
Bern [4] and Preparata, Vitter, and Yvinec [18] for k in the range between n l-! / log n and 
n J . Our algorithm is based on a problem-division approach to hidden-surface elimina- 
tion. In this approach one typically divides the problem — call it A— into two dissimilar 
subproblems B and C, solves B and C independently (usually by completely different 
techniques), and then "marries” the solutions to B and C to give a solution to A. Apply- 
ing this approach to the window rendering problem can lead to an algorithm that runs 
in 0(ft l,s logn + k log n) time, although the details are somewhat non-trivial. This, of 
course, is worse than previous solutions for all values of k. One of the ways we avoid these 
logarithmic multiplicative factors is by modifying the approach so that we divide A into 
B and C , and solve B, just as before, but then solve C while marrying the solutions to 
B and C. Other ways we avoid these factors are based on fundamental paradigms from 
computational geometry, including batched dynamic searching [8], space-sweeping [17], . 
and fractional cascading [5]. 

In the next section we give a high-level description of our algorithm, and in the 
subsequent sections (3-5) show how to implement each of its constituent steps. We 
conclude in Section 6. 

2 An Overview of the Window Rendering Algorithm 

Suppose we are given a collection 5 of n non-intersecting isothetic rectangles in IK 3 , i.e., 
a collection of rectangles parallel to the xy-plane such that all edges are parallel to either 
the x- or y-axis. The problem is to compute all the portions of each rectangle that are 
visible from z » ©c with light rays that are parallel to the r-axis (i.e., the projection 
plane is the xy-plane). 

More specifically, each rectangle R is given by a triple ((xi,yi), (x 2 ,y 2 ),r), where 
(xj,yx) is the lower-left corner of 12, (x 2 ,y 2 ) is the upper-right corner of R, and z is 
the x-coordinate of the plane to which R belongs. For the remainder of this paper we 
assume that the relationships “to the left of” and “to the right of” are with respect 
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to x-coordinates, that the relationships “above” and “below” are with respect to y- 
coordinates, and that the relationships “in front oP and “behind” are with respect to 
x-coordinates. 

There are many ways that one can specify what constitutes a solution to the hidden- 
surface elimination problem [12,13,16,20,21,22]. Let G be the planar subdivision deter- 
mined by a solution to the hidden-line elimination problem. Typically, a solution to the 
hidden-surface elimination problem is given by G, augmented so that each polygonal face 
of G stores the name of the rectangle of 5 that is visible in that face. Our exposition 
will gain in simplicity if our output specification, which we denote by Vt\s(S), generalizes 
this so that each face is itself a rectangle (our V is(G) is obtained from G by adding to 
it a small number of extra edges, as explained below). 

We begin our definition of Vis{S ) by examining the subdivision G a little more 
closely. For each vertex v of G either v corresponds to a (visible) corner point of a 
rectangle in 5 or v corresponds to an intersection of two visible edges (where one of 
them becomes occluded by the other, i.e., an intersection of the form T, _L, !-, or H). 
We call such intersections dead ends, and classify them into two types: vertical dead 
ends, where the terminating segment is vertical (i.e., T or JL), and horizontal dead ends, 
where the terminating segment is horizontal (i.e., h or H). In Figure lb, points e and 
/ are corners, aisaX, 6 is a J_, cissh, and d is a -I. In that same figure, points 
a, b, c and d are dead ends: a and b are vertical dead ends, while c and d are horizontal 
dead ends. For each corner point v in G, extend a horizontal ray from v in the direction 
that points away from the rectangle to which v belongs. Thus, in Figure lb, the ray 
emanating from e goes leftward, whereas that from / goes rightward. The point on the 
first (vertical) edge of G that is intersected by this ray is known as the horizontal shadow 
of v (if no such intersection with the ray occurs, i.e., the ray continues to infinity, then we 
consider the point at infinity to be the horizontal shadow of v). Call the new subdivision 
created from G by drawing an edge from each corner point to its horizontal shadow the 
rectangular decomposition of G, and let G‘ denote this subdivision. Obviously each face 
of G' is rectangular rather than polygonal. Figure 3 snows the G' that results from the 
G of Figure lb. In that figure, the horizontal shadow of e is g, that of / is at (-foe, y(/)). 
Our characterization, Vis(S ), of a solution to the hidden-surface elimination problem 
for 5 consists of the subdivision G * augmented so that each rectangular face of G' stores 
the name of the rectangle of 5 that is visible in that face. 
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Figure 3: The subdivision O'. The edges joining comers to their shad- 
ows are shown dotted. 

By defining Vts(S) in this way we get a characterization that consists entirely of rect- 
angular faces, yet is at most twice the size of G. For many applications, our specification 
should lead to simpler rendering algorithms, e.g., by simplifying scan-line conversion. 

For convenience, we assume throughout the paper that the planar graph Vts(S) 
lies in the sy-plane, so that any rectangular face of Vxs(S) is also in the xy-plane. Of 
course, each such rectangular face knows which rectangle of S is visible in it, and the 
r-coordinate of that rectangle (throughout the paper, each rectangular face of a Vis(S) 
is always assumed to have, attached to it, which rectangle of 5 is visible in it). 

There are a number of ways one can represent an embedded planar graph, such as 
Vis(S ). Three such representations are the “winged edge’ structure of Baumgart [2j, the 
“quad edge" structure of Guibas and Stolfi [11], and the “doubly-connected edge list" 
structure of Muller and Preparata [14,17]. Our algorithm does not depend on which 
representation one chooses, so long as the representation allows one to determine each 
of the following in time proportional to its size: 

1. all edges and faces adjacent to a given vertex v, as well as their orientation with 
respect to v, 

2. all vertices and faces adjacent to a given edge e, as well as their orientation with 
respect to e, and 

3. all vertices and edges that lie on the boundary of a given face /, in the order they 
occur around /. 
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Each of the mentioned representations provides this. 

Given an isothetic rectangle R in JR 3 we let z(fZ) denote the z-coordinate of the plane 
to which R belongs. Similarly, for any point p in SR 3 , we use x(p ), y(p), and z(p) to denote 
the s-, y-, and r-coordinate of p, respectively. Our terminology implicitly assumes that 
the observer looking at the scene from z — oo has his body parallel to the y-axis, with 
both arms extended so they are parallel to the x-axis (the reader probably inferred this 
from the way we drew Figure lb). Hence a vertical segment is parallel to the y-axis, 
whereas a horizontal segment is parallel to the x-axis. Similarly, we say that a plane is 
vertical (reap., horizontal) if it is parallel to the yz-plane (resp., xz-plane). In addition, 
we assume that the x-, y-, and z-coordinates of all rectangle endpoints are integers in 
the range [l,2n]. If this is not the case, then we apply a pre-processing step that, in 
turn for each of the three coordinates, sorts its values in increasing order and replaces 
each old value by its rank in the sorted list. This takes 0(n logn) time [l]. For the sake 
of simplicity, we assume that the x-coordinates of the rectangles’ endpoints are distinct, 
and similarly for y-coordinates and for z-coordinates. Modifying our algorithm for the 
general case is straightforward, and is left to the interested reader. 

The algorithm we outline below constructs Vis(S). 

Tlie Hidden Surface Elimination Algorithm (High-Level Description): 

Step 1. Probl em, division. In this step we divide the endpoints of the rectangles 
of S by vertical planes into r groups, each of size f4n/r] (with the possible exception of 
the last group, which may be smaller). Note that this also divides St 3 into r regions, each 
delimited by two vertical planes (except for the first and last such regions, which are 
delimited by only one such plane). We call these regions slabs, and let (ni,IT 2 ,...,n r ) 
denote the collection of slabs listed from left to right. For each II,- we construct Endpointi 
and S parti, where Endpointi denotes the set of all rectangles that have at least one 
endpoint in II,-, and S parti denotes the set of all rectangles that span IT, (i.e., all rectangles 
that intersect II,- but do not have an endpoint in it). (See Figure 4.) Let S,- be obtained 
from S parti by replacing every rectangle R in Span, by 3 n II,-. Similarly, let E, be 
obtained from Endpointi by replacing every rectangle R -.a Endpointi by RD IT,-. This 
step can easily be performed in 0(rn) time. 

_Step 2. Computing Vis(Ei). In this step we solve the hidden-surface elimination 
problem for each ignoring all rectangles not in This can be done in 0{[n/r)~) 
time for each Ei using the algorithm by McKenna [13). In addition, for each E, we 



Figure 4: R is in Endpoint x, 5 pan;, Spar 13, and Endpoint 4. 


perforin some preprocessing to help us perform the space-sweeping method of Step 3 
(given below). The total time complexity of this step is 0(rn -r n 2 /r), and its details 
can be found in Section 3. 

Step 3. Determining visible comers and vertical dead ends. In this step we 
determine all corners and vertical dead ends that belong to Vis(S), and for each such 
point we determine the rectangles of 5 that are visible in its vicinity (i.e., that are visible 
in the faces of V is(S) adjacent to it). In addition, for each corner point p we find the . 
horizontal shadow of p in Via(S; U £<), where p € II,- and its horizontal shadow is now 
constrained to be in II,- (so that the horizontal rays by which we defined shadows are 
stopped by the boundary of II,-, instead of being allowed to proceed to infinity). We call 
this the restricted horizontal shadow of p. The main idea of our method for performing 
this step is to perform a space-sweeping procedure that simultaneously sweeps through 
all the slabs Ili,...,n r to determine all the visible corners and vertical dead ends. This 
step requires 0(n log 2 n 4 rn 4- n 2 /r +Jt') time, where k' is the total number of (visible) 
points discovered in the sweep (note that £' < k). Its details are given in Section 4. 

Step 4. Determining visible horizontal dead ends. In this step we repeat 
Steps 1-3, except that the roles of the s-axis and y-axis are interchanged, that is, we 
divide by horizontal planes and sweep horizontally. We do not perform the extra work, 
as done in Step 3, to find visible corners and their shadows, however. That is, this step 
simply discovers all visible horizontal dead ends, and, for each one, all the the rectangles 
of 5 that are visible in its vicinity (i.e., that are visible in the faces of Vis(S) adjacent 
to it). 
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Step 5. Constructing Vts(S). In this step we combine the information computed 
in Steps 3 and 4 to construct a representation of Vis(S). Since we have already computed 
all the visible vertices in V:s(S), we begin by constructing the subdivision G that they 
determine. We do this using two calls to a bucket sorting routine [l], which takes 
0(n + k) time. To complete the construction of Vj$(5), we muss augment G with the 
true horizontal shadows of all visible corner points. (Recall tha: Step 3 only yields the 
restricted horizontal shadow of each corner point p, that is, the horizontal shadow of p 
restricted to the slab to which p belongs.) The main idea of our method for doing this 
involves the construction of left and right “horizontal exposure” lists for each TI,-, and the 
application of the fractional cascading technique [5] to these lists. This gives us a data 
structure that enables us to find each horizontal shadow in 0(logn 4- r) time, and then 
finish constructing Vts(S) in a further O(n) time. Performing the entire step requires 
0(nlogn + rn + k ) time. The details are in Section 5. 

End of High-Level Description. 

Assuming that we can perform each of the above steps correctly in the stated time 
bounds, this method gives us an algorithm that runs in 0(n log 5 n+ w + n 5 /r + k) time, 
where k is the size of the output. Setting r = y/n gives us the time bound of 0(n x,s + k) 
that we claimed in the introduction. 

Let us now give the details for each of the above steps. The details of Step 1 should 
be obvious given the above description, so we begin our discussion with Step 2. 

3 Step 2: Computing Vis[Ei ), and preparing for Step 3 

Recall that in Step 2 we wish to solve the hidden-surface elimination problem for each 
Ei in 0((n/r) 2 ) time. Since each E{ contains 0(n/r) rectangles, this amounts to being 
able to perform hidden-surface elimination in time that is quadratic in the number of 
rectangles. As mentioned above, we can do this by calling the algorithm of McKenna [13] 
as a subroutine. This section, however, does more than just call McKenna’s algorithm: 
it computes information that will be crucial to the efficient impiemen'.ation of Step 3. 
For that purpose, we need to briefly review McKenna's method and somewhat modify 
its output. 

When applied to a set S of isotbetic rectangles, McKenna’s method constructs the 
arrangement in the xy-plane produced by (i) extending each rectangular edge to infinity 
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Figure 5: The arrangement resulting from Figure 1. 


in each direction, (ii) projecting the lines so obtained on the sy-plane, and (iii) deter- 
mining the rectangle of 5 visible in each rectangular face of the arrangement produced 
by these projected lines. Figure 5 shows the arrangement resulting from the situation 
depicted in Figure 1 (in boldface are the edges of the arrangement that are projections 
of edges of rectangles in 5). 

Suppose we have already applied McKenna’s method to Ei, producing W(Ei). First 
we use the boundary of 11* to “clip” all the infinite horizontal edges of W (£,) (i.e., they 
now stop at this boundary instead of proceeding to infinity). Then we delete from W(Ei ) 
all the segments that are not in Vis(Ei), i.e., we eliminate each edge e that has the same 
rectangle of Ei visible on both sides of e, unless e joins a corner to the (restricted) 
horizontal shadow of that corner (recall that segments that extend from corner points to 
their respective horizontal shadows are part of Ws(£i)). This is easily done by checking 
whether both of the two faces of W (Ei) that are adjacent to e have the same rectangle 
of Ei visible in both of them, and whether e joins a corner to its (restricted) horizontal 
shadow. 

We now do some preprocessing that will help us efficiently implement Step 3. In 
Step 3 we will be performing a space-sweeping procedure in which w* -weep a horizontal 
plane A in the negative y-direction. At certain events during th.3 sweep we will need to 
update some dynamic data structures associated with the slab H,-. The preprocessing 
we do now facilitates our being able to perform these update operations efficiently. Ba- 
sically, we take advantage of the fact that the set of operations we will be performing on 
these dynamic data structures are known in advance, i.e., it is a batched problem. In gen- 
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eral, this paradigm of taking advantage of the batched nature of the dynamic problems 
that arise in geometric problems such as ours is known as batched dynamic searching. 
Applications of this paradigm to other geometric problems are given by Edelsbrunner 
and Overmars [8], for example. 

The details of our preprocessing steps are as follows. Suppose we wish to sweep 
a horizontal plane A through V is(E{) in the negative y-direction (as will happen for 
real in Section 4). Such a plane would encounter t = 0(n/ r) horizontal positions, each 
of which coincides with (possibly many) horizontal edges of V is(Ei). Each horizontal 
position determines a horizontal plane, which corresponds to a “snap shot" of the plane 
A at the time it would encounter that position. The collection of all such horizontal 
planes divides IT,- into t + 1 regions, which we call strips. Number these strips, from 
top to bottom, 1, 2, 3, and so on. Thus, the strips form a horizontal partitioning of IT,-. 
Now, for each rectangular face / of Vis(Ei) that intersects (say) the t x strips numbered 
to,to+ l,...,to + ti - I, create ti copies of /, each copy being associated with one of 
those tj strips. The copy of / associated with strip s gets assigned as its key the pair 
(a,z) where z is the z-component of the rectangle of £,• that is visible in rectangular 
face /. (Thus all the copies of / have keys with the same second component.) Observe 
that the sum over all / € Vis(E{) of the number of (s,z) pairs associated with / is 
0((n/r) 2 ), because each strip can determine at most 0[n/r ) (s, z) pairs, and there are 
0(n/r) strips. 

Let Ci denote the collection of (s, z) pairs, where each (s, z) pair contains a pointer 
to the face / in Vis(Ei ) associated with that pair. Now, bucket sort Q using the 
lexicographical ordering determined by the («,z) keys for comparisons. This takes 0(n+ 
(n/r) 2 ) time. For each strip s let 2, t , denote the part of this sorted list that has s as its 
key’s first coordinate. For each s compare the list with the list Zi t ,+i, constructing 
three sorted lists, 5ame,,„ Deicie^,, and Insert^! , defined as follows. The list 5ame,-., 
consists of all the rectangular faces / that have a copy in both and 2i t , + 1 (the key of 
/ in 5ame t|J is inherited from the copy in Zi fJ rather than from 'hat is 2 t >+i)* The list 
Delete^ consists of all the rectangular faces / that have a copy in Z. : but not in Zi <3+ \ 
(the key of / in Delete is the same as its key in 2,-,,). The list /nsert t - i+l consists of 
all the rectangular faces / that have a copy in 2, f ,+i but not in 2,-, # (the key of / in 
Inserti'j+i is the same as its key in 2 ti . + i). 

Note that the keys of the elements of Same; <s all have the same first component 
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(namely, s), so that the contents of Same,-,, are in fact sorted by the second components 
of their respective keys (that is, by the r-coordinates of the respective rectangles of E{ 
that are visible in them). Therefore, from now on, we shall ignore the first components 
of the keys of the elements of Same,.,. That is, a key is from now on a r-value rather 
than a pair (s,r). Similar remarks hold for each Delete and also for each Insert ,,,. 

For each rectangular face / in Insert, 1 , we determine its predecessor in Seme,-,, 
and store this in a field Pred,-,, + i(/) associated with /. 

Once this is completed, we no longer need the Same,-,, lists. The Delete,-,, and 
Insert,-,, lists, on the other hand, will become very helpful in performing the space- 
sweeping procedure in Step 3. Specifically, we shall use them to maintain a list (the 
current list) of rectangular faces otVis(Ei) that are intersected by a horizontal plane A 
(the plane we use for sweeping in the negative y direction). That is, to move some such 
plane A from the strip s to the strip s+ 1 we need only consult the lists Delete and 
Inserti ',+1 to tell us which rectangular faces to respectively delete and insert from the 
current list. In addition, by storing, in the field Pre<£,-,, + i(/), the predecessor in Same,-,, 
of each rectangular face / € Insert^ i, we enable ourselves to perform the insertion of 
/ into the current list in 0(1) time. Section 4 contains the details of how all these things 
are done. 

The computation ofVts(Ei) and of the Delete lists and Insert ,-,, lists (and their 
associated Predict fields) takes 0((n/r)") time for each E% t and hence the total time 
complexity of Step 2 is 0(r(n/r) 3 ) = 0(n 5 /r). 

We next show how to combine the information of the previous two steps to implement 

Step 3. 

4 Step 3: Computing visible corners and visible vertical 
dead ends 

In this step, we use the information computed in the previous step re aid in the implemen- 
tation of a space-sweeping procedure that computes (i) all the corners and vertical dead 
ends in all the V»s(5 l u£’,-)’s, (ii) for each such point, the rectangular faces of t't‘s(S,-u£i) 
that are adjacent to it, and (iii) for each such rectangular face, the rectangle of U £,- 
(and hence of 5) that is visible in it. 

We implement this step by sweeping space in the negative y-direction with a hori- 
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zontal plane A. We will be using a number of data structures to implement this space 
sweep: 

1. For each IT,- we maintain a variable Curst's,- that stores the name of the rectan- 
gle of Sparii having highest z-cocrcinafce among all elements of Spani currently 
intersected by A. Note: we never maintain all of V r xs(5,), just CurVtSi. 

2. For each II,- we maintain a list Di that stores all the rectangular faces of V ts(Ei) 
that are currently intersected by A, sorted by non-increasing r-coordinates of the 
rectangles of Ei visible in them (that is, by associating with each face the 2 - 
coordinate of the rectangle of £,• that is visible in it). Each Di is represented using 
a doubly linked list and has an entry-pointer (or “finger") /,• that points to the 
last face in D{ whose associated z- value is greater than z(CurV ts<). If there is no 
such face in Du then /,• points to the first element in D{. We also maintain for 
each 11,* an array of pointers called Wherti, such that for every rectangular face 
f € Vts(Ei), Wherti(f) points to the location of / in Di if / € Di, and is nil 
otherwise. 

3. We maintain a tree T that contains the set 5* of rectangles in U-.jSpan,- that are 
currently intersected by A. (Note that S> contains no more than n elements, since 
it is a subset of S.) The tree T is represented by a priority segment tree [3,12], 
where the leaves of T are associated with the slabs Hi, II 2 , . . ., n r , listed from left 
to right. For each internal node v of T we associate a slab II(v) that is the union 
of the slabs associated with the descendents of v in T. Let the i-th leaf be V{, 
so that II(vi) s= n*. In addition, for each node v we store a list Cover(v) that 
stores all the rectangles of S\ that span Il(v) but do not span n(porent(v)), sorted 
by decreasing z-coordinates. Each list Cover(v) is represented by a dynamic tree 
structure (e.g., a (2,3)-tree [l] or a red-black tree [10,23]) augmented with a pointer 
to the rectangle in Cover{v ) with largest z-coordinate (we call it Afcrfv)). Every 
node v also stores Best{v), which is the rectangle that has maximum r-rzordinate 
in the set of Max{w)’s stored in the nodes on the path from v to tr.e rest of T . It 
is not hard to see that a rectangle R can appear in no more than 2 log r different 

- Cover(v)'s, so that the space complexity of T is 0{r- f |5i| logr) = 0{r -f nlogr). 

The following lemma follows immediately from the above definitions. 
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Lemma 4.1: Assuming the above data structures are correctly maintained for the cur- 
rent position of X, then , for any n,-, CurVis { is equal to Best{v ; ) where v,- is the leaf 
that corresponds to n,- in T. 

Proof: An immediate consequence of the definitions. ■ 

Let Y be the list of the 2 n horizontal edges of the rectangles in 5, sorted in decreasing 
order of their y-coordinates. For each edge in Y we store the name of the rectangle that 
determined that edge. The list Y determines the events in the space sweep. The goal 
of the sweep procedure is to discover all visible corner points and visible vertical dead 
ends. Initially, CurVts,- is set to the “background” rectangle -oc, all the £>,• lists are 
empty, and all the Cover(v) lists in T are empty. 

To implement the space sweep we iteratively examine each edge in Y. Suppose l is 
the next event in Y. Let R be the rectangle of 5 to which / belongs. Let a (resp., b) be 
the left (resp., right) endpoint of l. There are essentially two different kinds of updates 
we must perform for l: updating the slabs containing a and b (Subsection 4.1 below), 
and updating the slabs spanned by l (Subsection 4.2 below). But before doing any of 
these, we begin by updating the tree T so that it already reflects the occurrence of event 
/. This is done as follows. 

If / is the upper edge of R then, just after event /, the sweeping plane A inter* 
sects R (whereas it did not before event /) and therefore we must insert R in all the 
Cover(v)'s to which it belongs and update their respective Afcr(v)’s accordingly. As 
already stated, there are at most 21ogr such nodes v € T whose respective Cover(v)'s 
are to be updated. Since each such update takes O(logn) time, the amount of time 
for all such updates is O(logrlogn) ss 0(log*n). On the other hand, if l is the lower 
edge of R then, just after event l, the sweeping plane A no longer intersects R (whereas 
it did before- event /) and therefore we must delete R from all the Cover(v) s to which 
it belongs and update their respective Mas(v )’ s accordingly. Of course, this too takes 
0(log 5 n) time, by an argument similar to that for the case of insertions. Finally, we 
must update the 3est(w ) values in T, so that they reflect the new Afax(v) values. This 
is easily done by a preorder traversal of T during which we maintain a stack A of ail 
the Best(v) values from the current node to the root. That is, if the traversal is at node 
urj, and if the path from w i to the root of T is w : , w*, . . . , w t , then the stack A contains 
Best(wi), Best(w 2 ), . . . , Best( w t ) (with 3est(w i) at the top of the stack). It is trivial to 
maintain the stack A during the traversal of T, as follows. When we traverse down T to 
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a new node v, we compare r(.4[top]) to z(Max( t>)) and push the rectangle achieving the 
larger of these two onto A[top\. When we traverse up T we pop the top element off A. 
The traversal for updating the Sest(v)’s takes 0(r) time, since T has O(r) nodes. Thus 
the time for updating T as a result of event 1 is 0(log" n + r). 

Now that T is updated, we can proceed to compute the effect of event 1 on the various 

n,’s. 


4.1 Processing the “endpoint” slabs 

We first describe the updating of D* where a € 11*. (The updating of Dy, where b € II/, 
is similar.) Since a is in II* there were two adjacent strips (say, strips s and s+l) in Step 2 
whose common boundary is the horizontal plane L containing 1. In moving A from s to 
s j. 1 past this horizontal plane L, we must delete the rectangular faces of V is(Ei) that 
will no longer be intersected by A and insert the new rectangular faces that will become 
intersected by A. Determining these rectangular faces is easy, given the preprocessing 
done in the previous step (Step 2). Suppose we are in strip s and crossing into strip s-r 1 
at L. To determine which faces to delete from D* we need only consult the list Delete*,,: 
for each / in it, we follow the Where* (/) pointer which tells us where / occurs in D* and 
thus enables us to delete / from D* in 0(1) time. To determine which rectangular faces 
to insert in D*, we consult the list Insert ^ x : for each / in that list, the Predh,,+i(f) 
pointer tells us which rectangular face /' immediately precedes the location in D* where 
/ is to be inserted, and following Where*(/' ) enables us to complete the insertion of / in 
Dh in 0(1) time. Of course after deleting / from D* we must update the Where* array by 
doing Where*(/) :s=nil. Similarly, after inserting / in D* we must change Where*(/) 
from being ail to pointing to where / is in D*. Updating D* therefore clearly takes 
0(|De/ete* ( ,| + |/nsert*,, + i|), which is 0(|£*|) » 0(n/r) because A coincides with at 
most 0(|J£*|) edges of Vts(£*). 

In addition, for each rectangular face / in Delete*,, U Insert ^, we perform the 
following computations for discovering corners and vertical dead ends on / in Vts(£,) 
that are also in Vis(Ei U 5,-). Let e be the projection of l onto / (in the projection 
plane); recall that since / € Delete*,, U/nsert*,, +1 , e must contain one of the horizontal 
boundaries of /. For each endpoint p of e, we check if p is in V»s(£ , t - U5,), by comparing 
s(CurVisi) to the z-coordinate of the rectangle of Ei that is visible in /: if z(CurV’i\s,) is 
the larger of the two then p is not in Vt's^US,), otherwise it is. If p is in K:s(D, u5, ) — 
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i.e., p is visible — then we must find out, for each rectangular face /' adjacent to p in 
Via(Ei), which rectangle of £ > , U5{ is visible in /'. This is easily done by comparing the 
rectangle CurVist to the rectangle of Ei that was visible in /' (the one with the higher 
r-coordinate wins). 

In addition, if p is a corner point, then we must determine its restricted horizontal 
shadow. To do this, we start walking from p along the horizontal ray leading to p’s 
shadow in Vi s(£/): we walk through all the rectangular faces of Vis(Ei) that are cut 
by this horizontal ray until either (i) we first hit a face whose z-coordinate is more than 
z(CurVis{), or (ii) we reach the boundary of IX,-. Either of events (i) or (ii) gives us the 
horizontal shadow of p in Vis(S U Ei), i.e., the restricted horizontal shadow of p. 

The above computations for processing the event / for slab II* require a total, over 
all / in Delete * t , U Inserth,,+i, of 0(|E,|) — 0(n/r) time (this is because even though 
Vis(Ei) has 0((n/r) 2 ) faces, the number of faces cut by any particular position of the 
sweeping plane A is 0(|£i|)). 

4.2 Processing the ‘‘spanned” slabs 

Assume that the processing of the "endpoint* slabs Ilf, and fl } - has already been done, 
as explained in Subsection 4.1. This section deals with processing the “spanned* slabs, 
i.e., the Ilf's for which R € Span,-. (Recall that R is the rectangle of 5 to which event l 
belongs.) 

Let U denote the set of H,* ’s that are affected by event / and thus will need further 
processing. Thus U consists of the Ilf’s whose respective CurVts,- ’s will change as a 
result of event / (either CurVts,- was R and will cease to be R, or it was not R and 
will become R ). Finding U is easy to do: Lemma 4.1 implies that the new value of each 
CurV ts,- — call it NewCurV is , — ; just after event l is readily available in the tree T (recall 
that T has already been updated to reflect event l). Therefore we can easily compute U 
as follows. For each Ilf, compare CurV is,- to NewCurV ts,-, i.e., to the Best(vi) entry 
available in T: if they are not the same rectangle then include II/ in U. 

For each II,- € U , we perform the following computation. For convenience, in what 
follows we let Ri stand for CurVisi, and we let Rj stand for NewCurV ts,-. Thus Ri 
is the rectangle that is in CurVisi just before event /, and Rj is the rectangle that 
becomes in CurVts,- just after event / (Ri # Rj by definition of U ). Note that R will 
be one of R\ or R; (Figure 6 depicts the case R\ — R). We obtain from D, the set D\ 
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Figure 6: Illustrating the case z(R\) > z(i? 2 )» 


of rectangular faces of Vis(Ei) whose associated z- values fall between r(.Ri) and :{Rz). 
If z(Ri ) > z(f?j) (as in Figure 6), then the rectangular faces in D 1 are not visible (in 
Ei U £,•) before /, but become visible after /. Otherwise, if z(Ri) < z(f?j), then the 
rectangular faces in D 1 are visible before l, but are not visible after l. In either case, (a 
portion of) each of these rectangular faces is part of the output, Vis(Ei U £,•). For each 
such rectangular face /, we determine the intersection of / with A, the sweep plane (or, 
equivalently, the projection of / onto /). Let p € / be an endpoint of this intersection, 
and let t be the vertical line segment of Vts(£,-) that contains p. For each such point p, 
we find the rectangles of Ei U 5,- that are visible in the vicinity of p by comparing the 
two z-values (in Vts(E,)) of the two rectangular faces adjacent to e, to s(f?i) and 2 (^ 2 ). 
Note that p forms a visible vertical dead end in Vis(E{ U 5,-) (and hence in V"ts(S)). We 
complete the computations for H by assigning CurVt's,- := R 2 . The processing of each 
such IT i € U clearly requires O(k') time, where k' = \D'\ (recall that a portion of each 
face in D ' is visible in Ei U 5,-, hence is part of the output). 

4.3 Analyzing Step 3 

When the slab-sweeping procedure terminates we will have computed all the corner 
points, restricted horizontal shadows, and vertical dead ends in V*:s(5; U (We prove 
this in the next lemma.) From the comments made during the detailed presentation of 
Step 3, it is easy to see that performing this entire step requires 0(n log 2 n+nr+n 2 / r-*-/c) 
time, where k is the size of Vis(S). In the following lemma we establish the correctness 
of our method so far. 
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Lemma 4.2: The previous steps correctly find all corner points a nd vertical dead ends 
in every Vis(Si U Ei) and, for each such point p, correctly determine the rectangles of 
Ei U Si that are visible its vicinity (7. ft., in each rectangular face ofVis(Ei U 5,) that is 
adjacent to p). 

Proof: (»•:) Suppose p is a corner point or vertical dead end :r. VisiSi U Ei), where 
Tli is the slab containing p. We wish to show that p will be discovered in the previous 
steps of the algorithm. Let us treat each of the possible cases. 

Case 1. p is a corner point, the projection of a vertex p' of some R € 5. Let e 
be the horizontal edge of R containing p'. Since p is a vertex in Vis{Ei U Si), p must 
be a vertex in Vis(Ei). Therefore, Step 2 will have computed which rectangle of 5 is 
visible in each face that is adjacent to p in V is(Ei). Therefore when event e is processed 
by Step 3, that step must indeed discover that p is visible in Vis(Ei U 5,-) (this follows 
from the way Step 3 works). Moreover, for each face / of Vis{E,) that is adjacent to 
p. Step 3 correctly determines the rectangle of 5 visible in / when it compares CurVisi 
to the rectangle of Endpoint ,• that is visible in / and chooses the one with the larger 
z-coordinate. 

Case 2. p is a visible vertical dead end in V is(Ei U Si), i.e., it is of the form T or 
X. If p is a vertex in V > :s(£’,) l then an argument similar to that for Case 1 applies. So 
suppose p is not a vertex in Vts(£ 1 ,), i.e., it occurs on the interior of an edge e of Vis(Ei). 
Obviously e must be vertical so that a portion of it becomes the vertical part of the T 
or X in Via(Ei U Si), the horizontal part of the T or X being contributed by the edge 
of a rectangle in Spani. We continue the discussion assuming that p is, in V:s(£iUS,), 
of the form X (the argument for when p is of the form T is similar). As already stated, 
the X that p forms is the intersection of a portion of the (vertical) segment t with a 
horizontal line segment l that is the projection of an edge V of a rectangle, call it fJbi 8 , 
that spans 3T t -. (Note that R^ig becomes the new CurV ts, just after event /' is processed.) 
Let /' and f" be the two rectangular faces of Vis(Ei) that are adjacent to e just above 
p (i.e., just before event /'). Let B! and R" be the two rectangles of Ei that are visible 
in Vis(Ei) in (respectively) faces /' and /". Then R' and R" must both have lower 
z-coordinates than that of R^ f (because p is a X in Vis(Ei U Si)). Moreover, at least 
one of R! and R" (possibly both) must be visible around p in Vis(Ei U S;), i.e., have 
a z-coordinate larger than that of the CurV isi just before event l' (otherwise p could 
not be a X). Therefore the search performed by Step 3 for event /' will discover at least 
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one of /* and J"\ hence, discover the intersection of e with / at p and all the rectangles 
visible in the faces around p. 

(-<=:) Let p be any point determined to be “visible” by Step 3. We wish to show 
that this action of Step 3 is correct, i.e., that p is indeed visible in Vis(Si U £*), where 
II,- is the slab containing p. Obviously p must be in Vts(Ei) as well, but not necessarily 
as a vertex (perhaps as a point along some edge). Any rectangle R that can possibly 
obstruct p is either in Ei or in 5part,-. Thus, since we compare p to the rectangles in 
E{ in Step 2, and, in Step 3, to the rectangle with largest r-coordinate whose projection 
contains p, p is indeed a visible point. Moreover, since p must correspond to an event in 
one of the plane sweeps of Steps 2 and 3, by arguments similar to those for the (»>) part 
of the proof, we do discover all the rectangles of 5 that are visible in the faces adjacent 
to p. This completes the proof. ■ 

In Step 4 we repeat the above three steps, except that the roles of the r-axis and 
y-axis are reversed, and we do not bother performing the extra steps to determine corner 
points and their respective shadows (this was already done in Step 3). Thus, we find 
all the visible horizontal dead ends. This gives us all the visible vertices of V:s(S), 
except those that are horizontal shadows. In the next section we show how to extend 
the restricted horizontal shadows (in V is(S{ U Ei)’s) into true horizontal shadows (in 
Vts(S)), thus giving us all the vertices of Vts(S). 

5 Step 5: Constructing Vis(S) 

In this step we complete the construction of W.s(S). From Steps 3 and 4 we have all 
the visible vertices of Via(S), except those that are horizontal shadows. Moreover, for 
each visible vertex p we have the rectangles of 5 that are visible in each face adjacent to 
p. In order to complete the construction of Vis(S) we must determine all the horizontal 
shadows in Vis(5), as well as all the adjacency relationships between vertices and edges 
in V»s(S). 

Let B be the set of all visible horizontal dead ends, visible vertical dead ends, visible 
corner points, and the restricted horizontal shadows of visible corner points. We begin 
by constructing G, the planar graph determined by the adjacencies of the vertices in 
B. We construct all the adjacencies between these vertices by performing two calls to a 
2-dimensional bucket sorting routine, each time giving B as the set to be sorted. In the 
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first call we specify that the routine should sort lexicographically by (x, y) coordinates, 
resulting in the list B- v . In the second call we specify that the routine sort lexicograph- 
ically by (y, x) coordinates, giving the list B yz . This requires 0(n- f k) time, where k is 
the number of vertices in Vis(S). For any vertex p in B we determine the other vertices 
of B that ar« adjacent to p in G by examining the immediate predecessors and successors 
of p in B X y In addition, recall that we have for each p the rectangles that are 

visible in each cf the faces of G adjacent to p. 

Having so constructed G, we need only extend each restricted horizontal shadow in 
G to a true horizontal shadow. Let us re-divide the space by the vertical dividing planes 
used in Step 1, again giving us the slabs XTt» IT-, ..., IT r . From the first part of this 
Step 5 (explained above) we now have all the vertices in V js(S t - U Ei) as well as all their 
adjacencies in Vts(5). We say that a vertical segment s in Vis(Si U Ei) is horizontally 
exposed from the left (resp., right) if there is a horizontal line that intersects no vertical 
segments in Vis(Si U Ei) between s and the left (resp., right) boundary of II,-. For each 
slab 11,- we define the left profile (resp., right profile) to be the y-sorted list of vertical 
segments of Vis(S t - U £,■) that are horizontally exposed from the left (resp., right). Let 
Li and £,* denote the left and right profiles of II,-, respectively. 

The method for constructing Li is as follow's (the method for Hi is similar). Let Li 
be the set of all vertices p in Vis(Si U Ei) such that p is adjacent to a horizontal (visible 
or shadow) segment in V ts(S{ U Ei) that intersects the left boundary of II,-. We can 
construct L, by examining all the vertices in Vis{S{ U Ef) once. Sort the points in Li by 
decreasing y-coordinates. Each point p in Li determines a segment in Li, namely, the 
vertical segment that is adjacent to p. In addition, for each point p we traverse the face 
of Vis{Si U Ei) that is adjacent to p, but does not contain the vertical segment adjacent 
to p, to see if it contains a vertical segment horizontally exposed from the left. Note 
that by the definition of the points in Li we will traverse each such face only once. After 
we have completed all such traversals, we will have the entire list L,-. This construction 
takes 0(n -r kf) time, where h, is the number of vertices in V is [ Si U Ei). 

We construct a graph that has a node for each £,• and Ri list, and connects each fZ, 
to and and each X,- to X,- + j. Using the terminology of Chazelle and Guibas [5], this 
graph is a catalogue graph. Thus, we can apply the “fractional cascading” technique [5j to 
build a data structure that consists of augmented lists L\ and R\, for each i in (1, 2, ..., r), 
as well as a number of pointers between consecutive augmented lists, such that given the 
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position of a point p in some L\ list this structure allows one to locate p in L, and 
in O(l) time. The similar property holds for the lists. Using the method of Chazelle 
and Guibas [5], this data structure can be constructed in time and space proportional 
to the total number of elements in all the lifts (which is 0(n + k)). 

Let us return to the problem at hand, namely, completing the construction of V":s(5) 
by finding the true horizontal shadow pcints of each corner point p that currently has 
its restricted horizontal shadow falling on a boundary of n,-, where p € ll,-. Let us con- 
centrate on the computation of the true horizontal shadow of a point p whose restricted 
horizontal shadow falls on the left boundary of 11,- (the method for the case when p’s 
restricted shadow falls on the right boundary of IT,- is similar). We first locate y(p) in 
i?J_ l in O(logn) time by using the binary search technique. Then, we can locate y(p) in 
JJf-x in 0(1) time. If the interval in Ri-\ in which y(p) falls contains a vertical segment, 
then we have found the true horizontal shadow of p — simply compute the intersection 
of the line y = y(p) with this segment. If, on the other hand, this interval is empty of 
any vertical segments (of V»s(S,-_x U Ei-i)), then we use the position of y(p) in .K-.j 
to locate y(p) in in 0(1) time. We then repeat the above procedure until we lo- 
cate p’s horizontal shadow or run out of lists to search in (in which case p’s shadow is 
(— oo,y(p))). This searching procedure takes at most 0(logn + r) time for each corner 
point p. 

The only thing left, then, is to link each new horizontal shadow into the graph C to 
give us Vis(S) while removing all the old (restricted) horizontal shadows they replace. 
To perform this last computation construct a tuple (x, y, y(p)), where (x, y) is the upper 
endpoint of the vertical segment on which the horizontal shadow (x, y(p)) of p lies. We 
can then sort all theses tuples in 0(n) additional time. Using this sorted list we can 
complete the construction of Vts(S) in 0(n) time. Since there are at most 0(n) corner 
points for which we perform this procedure, the total time for finding these horizontal 
shadows is 0(n log n + rn + k) time. This completes the algorithm. We summarize the 
above discussion in the following theorem. 

Theorem 5.1: Given a set S of n iso the tic rectangles in 2 R 3 , one can solve the hidden- 
surface elimination problem for S in 0(n log 2 n + (n : /r) + rn + k) time, where r is any 
integer parameter and k is the size of the output. ■ 

Corollary 5.2: One can solve the hidden-surface elimination problem for an isothetic 
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collection of rectangles in 0(n i s + k ) time. 
Proof: Set r se n . ■ 


6 Conclusion 

In this paper we have given an algorithm for solving the hidden-surface elimination 
problem for rectangles that runs in 0(n 1,s + k) time, which is output-sensitive and 
simultaneously worst-case optimal (for quadratic k). Moreover, our algorithm should be 
competitive with existing methods for realistic values of n. Of course, solving hidden- 
surface elimination for rectangles is a special case of the general problem. Can the general 
hidden-surface elimination problem be solved in time proportional to k -h o[n ‘ ) ? 
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